SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 



O 

3 






X 



Shannon Meets Nash 
on the Interference Channel 

Randall A. Berry and David N. C. Tse 



Abstract 



The interference channel is the simplest communication scenario where multiple autonomous users 
compete for shared resources. We combine game theory and information theory to define a notion 
of a Nash equilibrium region of the interference channel. The notion is game theoretic: it captures 
the selfish behavior of each user as they compete. The notion is also information theoretic: it allows 
each user to use arbitrary communication strategies as it optimizes its own performance. We give an 
exact characterization of the Nash equilibrium region of the two-user linear deterministic interference 



interference channel to within 1 bit/s/Hz.. 



fvi | channel and an approximate characterization of the Nash equilibrium region of the two-user Gaussian 

>' 
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I. Introduction 

Information theory deals with the fundamental limits of communication. In network infor- 
mation theory, an object of central interest is the capacity region of the network: it is the set 
of all rate tuples of the users in the network simultaneously achievable by optimizing their 
communication strategies. Implicit in the definition is that users optimize their communication 
strategies cooperatively. This may not be a realistic assumption if users are selfish and are only 
interested in maximizing their own benefit. Game theory provides a notion of Nash equilibrium 
to characterize system operating points, which are stable under such selfish behavior. In this 
paper, we define and explore an information theoretic Nash equilibrium region as the game 
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theoretic counterpart of the capacity region of a network. While the Nash equilibrium region is 
naturally a subset of the (cooperative) capacity region, in general not all points in the capacity 
region are Nash equilibria. The research question is then to characterize the Nash equilibrium 
region given a network and a model of the channels. 

The two-user interference channel (IC) is perhaps the simplest communication scenario to 
study this problem. Here two point-to-point communication links interfere with each other 
through cross-talks. Each transmitter has an independent message intended only for the corre- 
sponding receiver. The capacity region of this channel is the set of all simultaneously achievable 
rate pairs (i?i,i?2) in the two interfering links, and characterizes the fundamental tradeoff 
between the performance achievable on the two links in face of interference. 

In the cooperative setting, the users jointly choose encoding and decoding schemes to achieve 
a rate pair (i?i, R 2 ). In the game theoretic setting, on the other hand, we study the case where 
each user individually chooses an encoding/decoding scheme in order to maximize his own 
transmission rate. The two users can be viewed as playing a non-cooperative game, where a user's 
strategy is its encoding/decoding scheme and its payoff is its reliable rate. A Nash equilibrium 
(NE) is a pair of strategies for which there is no incentive for either user to unilaterally change 
its strategy to improve its own rate. These are incentive-compatible operating points. The Nash 
equilibrium region of the IC is the set of all reliable rate pairs each of which can be achieved 
at some NE. Our focus is on a "one-shot" game formulation in which each player has full 
information, i.e. both players know the channel statistics, the actions chosen by each player, as 
well as their pay-off function. 

A particular IC we focus on in this paper is the two-user Gaussian IC shown in Figured] This 
is a basic model in wireless and wireline channels (such as DSL). Game theoretic approaches for 
the Gaussian IC have been studied before, e.g. J51-|[8l. However, there are two key assumptions 
in these works: 1) the class of encoding strategies are constrained to use random Gaussian 
codebooks; 2) the decoders are restricted to treat the interference as Gaussian noise and are hence 
sub-optimal. Because of these restrictions, the formulation in these works are not information- 
theoretic in nature. For example, a Nash equilibrium found under these assumptions may no 
longer be an equilibrium if users can adopt a different encoding or decoding strategy. 

In this paper, we make three contributions. First, we give a precise formulation of an in- 
formation theoretic NE on general ICs, where the users are allowed to use any encoding and 
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Fig. 1. Two-user Gaussian interference channel. 

decoding strategies. Second, we analyze the NE region of the two-user linear deterministic 
IC 0. This type of deterministic channel model was first proposed by [0 in the analysis of 
Gaussian relay networks, and the deterministic IC has been shown to be a good approximation 
of the Gaussian IC in Q. For this IC, we give a simple exact characterization of the NE region. 
At each of the rate pairs in the NE region, we provide explicit coding schemes that achieve the 
rate pair and such that no user has any incentive to deviate to improve its own rate. Somewhat 
surprisingly, we find that in all cases, there are always Nash equilibria which are efficient, i.e., 
they lie on the maximum sum-rate boundary of the capacity region. In particular, for channels 
with symmetrical channel gains, the symmetric rate point on the capacity region boundary is 
always a Nash equilibrium. Our third contribution is to use these insights to approximate the NE 
region of the Gaussian IC to within 1 bit/s/Hz. This result parallels the recent characterization 
of the (cooperative) capacity region of the same channel to within 1 bit 01 . 



II. Problem Formulation 

Let us now formally define the communication situation for general interference channels. In 
subsequent sections, we will specialize to specific classes of interference channels. 

Communication starts at time 0. User i communicates by coding over blocks of length iVj 
symbols, i = 1,2. Transmitter i sends on block k information bits b a \ . . . ,b\ £. by transmitting a 
codeword denoted by xj = [x.\ (1), . . . , xj (N{)]. All the information bits are equally probable 
and independent of each other. Receiver i observes on each block an output sequence through 
the interference channel, which specifies a stochastic mapping from the input sequences of 



user 1 and 2 to the output sequences of user 1 and 2. Given the observed sequence {y 



(*) 
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[y- '(1),. . . ,y\ (iVj)], k = 1,2, . . . ,}, receiver i generate guesses fy e ' for each of the information 
bit. Without loss of generality, we will assume that each receiver i performs maximum-likelihood 
decoding on each bit, i.e. chooses b\ that maximizes the a posterior probability of the observed 
sequence y\ ,y\ , . . . given the transmitted bit b ie . 

Note that the communication scenario we defined here is more general than the one usually 
used in multiuser information theory, as we allow the two users to code over different block 
lengths. However, such generality is necessary here, since even though the two users may agree 
a priori on a common block length, a selfish user may unilaterally decide to choose a different 
block length during the actual communication process. 

A strategy Si of user i is defined by its message encoding, which we assume to be the same 
on every block and involves: 

• the number of information bits B t and the block length iVj of the codewords, 

• the codebook Q, the set of codewords employed by transmitter i, 

• the encoder f\ : {1, . . . , 2 Bi } x flj — >■ Ci, that maps on each block k the message m\ : = 
(b a , . . -big) to a transmitted codeword xj = fi{ra\ ' ,u>\ ) G C i? 

• the rate of the code, Ri(si) = -Bj/iVj. 

A strategy s\ of user 1 and S2 of user 2 jointly determines the average bit error probabilities 

Pi k) '■= J: Efii ^(X ( ? + fo i?)> * = 1, 2 o Note that if the two users use different block lengths, 
the error probability could vary from block to block even though each user uses the same 
encoding for all the blocks. However, if they use the same block length, then the error probability 
is the same across the blocks for a user, which we will denote by pi for user i. 

The encoder of each transmitter i may employ a stochastic mapping from the message to 

(k) 

the transmitted codeword; oj\ E iZj represents the randomness in that mapping. We assume 
that this randomness is independent between the two transmitters and across different blocks. 
Furthermore, we assume that each transmitter and its corresponding receiver have access to a 

(k) 

source of common randomness, so that the realization u) is known at both transmitter i and 



s 



receiver %, but not at the other receiver or transmitter. 



'Average bit error probabilities are more meaningful than codeword error probabilities in a setting, such as ours, where users 
can vary the blocklength they are using. 

2 Such common randomness is not needed for many of the results in the paper, but allowing for it simplifies our presentation. 
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For a given error probability threshold e > 0, we define an e-interference channel game as 
follows. Each user i chooses a strategy Sj, i — 1, 2, and receives a pay-off of 

Ir( Si ), ifp? ) (si,s 2 )<e,VA:, 

7Ti(si,S 2 ) = < 

I 0, otherwise. 

In other words, a user's pay-off is equal to the rate of the code provided that the probability of 
error is no greater than e. A strategy pair (si, s 2 ) is defined to be (1 — e)-reliable provided that 
they result in an error probability Pi(s 1 , s 2 ) of less than e for i = 1, 2. An (1 — e)-reliable pair 
of strategies is said to achieve the rate-pair (-R(si), R(s 2 )). 

For an e-game, a strategy pair (si, s^) is a Nash equilibrium (NE) if neither user can unilaterally 
deviate and improve their pay-off, i.e. if for each user i = 1, 2, there is no other strategy s« such 
thaltj TTi(si, Sj) > TTi(s*, Sj). If user i attempts to transmit at a higher rate than what he is receiving 
in a Nash equilibrium and user j does not change her strategy, then user z's error probability 
must be greater than e. 

Similarly, a strategy pair («*, s 2 ) is an 77-Nash equilibriumj (77-NE) of an e-game if neither 
user can unilaterally deviate and improve their pay-off by more than 77, i.e. if for each user i, 
there is no other strategy s, such that 7Tj(sj, s*) > n^s*, s*) +77. Note that when a user deviates, 
it does not care about the reliability of the other user but only its own reliability. So in the above 
definitions (s i? s*) is not necessarily (1 — e)-reliable. 

Given any e > 0, the capacity region C of the interference channel is the closure of the set 
of all rate pairs (Ri, R 2 ) such that for every e G (0,e), there exists a (1 — e) -reliable strategy 
pair (si, s 2 ) which achieves the rate pair (R 1 ,R 2 ). The Nash equilibrium region Cne of the 
interference channel is the closure of the set of rate pairs (R±, R 2 ) such that for every 77 > 0, 
there exists a e > (dependent on 77) so that if e G (0, e), there exists a (1 — e)-reliable strategy 
pair (si, s 2 ) that achieves the rate-pair (i? 1; R 2 ) and is a 77-NE. Clearly, Cne C C. 

First, we make a few comments about the definition of Cne- In this definition, the parameter 
e is introduced so that (1 — e) -reliable strategy pairs need only exist for "small enough" values 
of e. In the definition of the capacity region for the interference channel this constraint is not 

3 In this paper, we use the convention that j always denotes the other user from i. 

4 In the game theoretic literature, this is often referred to as an e-Nash equilibrium or simply an e-equilibrium for a game (9] 
page 143]. 
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needed, i.e. the region is equally well defined by requiring the given conditions to hold for any 
e > (since, clearly if a pair of strategies are (1 — e) -reliable, they are also (1 — e) -reliable 
for all e > e). However, when defining C NE , this condition is important. In particular a pair 
of strategies can be an 77-NE for an e-game, but not an 77-NE for an e-game for e > e, since 
increasing the error probability threshold enlarges the set of possible deviations an agent may 
make. As an extreme example, consider the case where e = 1, in which case each agent can 
achieve an arbitrarily high pay-off regardless of the action of the other user and so no 77-NE 
exists. Thus, if we required our definition to hold for any e > 0, Cne would be empty. 

Next, we turn to the use of 77-NE in the definition. A more natural approach would be to instead 
simply use NE. In other words, define Cne to be the closure of the rate pairs (R±, R 2 ) such that 
for any e small enough, that there exists a (1 — e)-reliable strategy pair (si,s 2 ) which achieves 
the rate-pair (R 1 , R 2 ) and is a NE of a e-game. The difficulty with this is that to determine such 
a NE essentially requires one to find a particular scheme that achieves the optimal rate for a 
given non-zero error probability. Finding such a scheme that is extremely difficult and in general 
an open problem^ By introducing the slack 77, these difficulties are removed. Moreover, since 
we require that this definition hold for all 77 > 0, this slack can be made arbitrarily small. 

Finally, we would like to comment on the use of different block lengths in our definitions. 
First, it can argued that if there is a (1 — e)-reliable strategy pair (si,s 2 ) that achieves a rate 
pair (R 1 , R 2 ) using codes of block lengths N±, N 2 , then there exists a (1 — e) strategy pair that 
achieves the same rate pair but with each user using the same block length. This follows by 
considering using "super-blocks" of length N, where iV is the least common multiple of Ni and 
N 2 . Over these super-blocks the users can be viewed as using two equal-length codes. The error 
probabilities, being the average bit error probabilities now across longer blocks, remain less than 
e. This means that in computing the capacity region C, we can without loss of generality consider 
only strategies in which both users use the same block lengths. Also, in the Nash equilibrium 
definitions, we can without loss of generality assume that in the nominal strategy, the two users 
use the same block length (although each user is allowed to deviate using another strategy of a 
different block length.). 

5 Moreover, it is not even clear if there exists such a scheme, i.e. a scheme that achieves the supremum of the rates over all 
1 — e reliable schemes. 
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Fig. 2. The deterministic model for the point-to-point Gaussian channel. Each bit of the input occupies a signal level. Bits of 
lower significance are lost due to noise. 



III. The Linear-deterministic IC 

A. Deterministic Channel Model 

Let us now focus on a specific interference channel model: a linear deterministic channel 
model analogous to the Gaussian channel. This channel was first introduced in [4J. We be- 
gin by describing the deterministic channel model for the point-to-point AWGN channel, and 
then the two-user multiple-access channel. After understanding these examples, we present the 
deterministic interference channel. 

Consider first the model for the point-to-point channel (see Figure [2]). The real- valued channel 
input is written in base 2; the signal — a vector of bits — is interpreted as occupying a succession 
of levels: 

x = O.&1&2&3M5 

The most significant bit coincides with the highest level, the least significant bit with the lowest 
level. The levels attempt to capture the notion of signal scale; a level corresponds to a unit of 
power in the Gaussian channel, measured on the dB scale. Noise is modeled in the deterministic 
channel by truncation. Bits of smaller order than the noise are lost. Note that the number of 
bits above the noise floor correspond to log 2 SNR, where SNR is the signal-to-noise ratio of the 
corresponding Gaussian channel. 

The deterministic multiple-access channel is constructed similarly to the point-to-point channel 
(Figure [3]). To model the super-position of signals at the receiver, the bits received on each level 
are added modulo two. Addition modulo two, rather than normal integer addition, is chosen to 
make the model more tractable. As a result, the levels do not interact with one another. 
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Fig. 3. The deterministic model for the Gaussian multiple-access channel. Incoming bits on the same level are added modulo 
two at the receiver. 



We proceed with the deterministic interference channel model (Fig . |4j) . There are two transmitter- 
receiver pairs (links), and as in the Gaussian case, each transmitter wants to communicate only 
with its corresponding receiver. The signal from transmitter i, as observed at receiver j, is scaled 
by a nonnegative integer gain aji = 2 nji (equivalently, the input column vector is shifted up by 
riji). At each time t, the input and output, respectively, at link i are Xj(t), yj(t) G {0, l} 9 , where 
q = maxijUij. Note that ria corresponds to log 2 SNRj and riji corresponds to log 2 INR,;, where 
SNRj is the signal-to-noise ratio of link i and INRjj is the interference-to-noise ratio at receiver 
j from transmitter i in the corresponding Gaussian interference channel. 

The channel output at receiver i is given by 



y J (t) = S"-"-X 1 (t) + S 9 -"-X 2 (t), 



(1) 



where summation and multiplication are in the binary field and S is a q x q shift matrix, 



A) ••■ o\ 

1 ■•■ 
1 ••■ 



\o 



(2) 



1 0/ 
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Fig. 4. At left is a deterministic interference channel. The more compact figure at right shows only the signals as observed at 
the receivers. 



If the inputs Xj(t) are written as a binary number Xi, the channel can equivalently be written as 

Vi = [anXi + a 12 x 2 \ 
y 2 = [a 21 x t + a 22 x 2 \ , 

where addition is performed on each bit (modulo two) and [ ■ J is the integer-part function. 

In our analysis, it will be helpful to consult a different style of figure, as shown on the right- 
hand side of Fig. @] This shows only the perspective of each receiver. Each incoming signal is 
shown as a column vector, with the highest element corresponding to the most significant bit and 
the portion below the noise floor truncated. The observed signal at each receiver is the modulo 
2 sum of the elements on each level. 

The deterministic interference channel is relatively simple, yet retains two essential features of 
the Gaussian interference channel: the loss of information due to noise, and the superposition of 
transmitted signals at each receiver. The modeling of noise can be understood through the point- 
to-point channel above. The superposition of transmitted signals at each receiver is captured 
by taking the modulo 2 sum of the incoming signals at each level, as in the model for the 
multiple-access channel. 



B. Main Results 

To begin, we give the capacity region, C, of our two-user deterministic interference channel. 
This region is given by Theorem 1 in iflOll . which applies to a larger class of deterministic 
interference channels. For our model, the resulting region becomes the set of non-negative rates 
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satisfying^ 



R\ < riu 
R2 < n 2 2 

Ri + R 2 < (nn - ni 2 ) + + max(n 22 , n 12 ) 
Ri + R 2 < (n 22 - n 2 i) + + max(nn, n 2 i) 
Ri + R 2 < max(n 2 i, (nn - rii 2 ) + ) 

+ max(ni 2 , (n 22 - n 2 i) + ) 
2Ri + R 2 < max(nn, n 2 i) + (mi - "-i2) + 

+ max(ni2, (n 22 - n 2t ) + ) 
Ri + 2R 2 < max(n 22 , n u ) + (n 22 - ra 21 ) + 
+ max(n 2 i, (nn - n u ) + ). 



(3) 

(4) 
(5) 
(6) 

(7) 

(8) 

(9) 



Our main result, stated in Theorem \T\ below is to completely characterize Cne for the two-user 
deterministic interference channel model. This characterization is in terms of C and a "box" B 
in R 2 + given by (see Fig. [5]) 



B = {(R h R 2 ) :Li<Ri< U h \/i = 1, 2}, 



where for each user i = 1,2, 



and 



U; 



i-'i [nn n^j ) , 



nn -min(L i ,n ij ), 



II Tlij \ ""£■£) 



min((n ij - Lj) + , no), if n {j > n 



i] ^ '"it- 



(10) 



(11) 



We now state our main result. 
Theorem 1: Cne = C H B. 

6 The boundaries of the region in [10] is given in terms of conditional entropies that must be maximized over any product 
distribution on the channel inputs. For our model the optimizing input distribution for each bound is always uniform over the 
input alphabet. The given bounds follow. 
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Fig. 5. An example of the box B. The values of the four corner points are indicated in the figure. 



First let us interpret the bounds M, L2, E/i, U2. The number L, is the number of levels that 
user i can transmit above the interference floor created by user j, i.e. the number of levels at 
receiver % that cannot see any interference from user j. These are always the most significant 
bits of user i's transmitted signal. In the example channel in Figure H these correspond to the 
top level for transmitter 1 (Li =1) and the top 3 levels for transmitter 2 (X 2 = 3). The number 
Ui is the number of levels at receiver i that receive signals from transmitter i but are free of 
interference from the top Lj levels from transmitter j. In the example channel in Fig. HI these 
correspond to the top level at receiver 1 (JJ\ = 1) and the top three levels at receiver 2 ([/ 2 = 3). 

Intuitively, it is clear that at any 77-NE, user i should have rate at least M these levels are 
interference-free and user i can always send information at the maximum rate on these levels. 
This will create interference of maximum entropy at a certain subset of levels at receiver j and 
render them un-usable for user j. The rate for user j is bounded by the number of remaining 
levels that it can use. This is precisely the upper bound Uj. What Theorem [TJ says is that any 
rate pair in the capacity region C subject to these natural constraints is in Cne- 

To illustrate this result, consider a symmetric interference channel in which n\\ = ^22 and 
tt-12 — n 2i- Let a = nji/riu be the normalized cross gain. Four examples of C and B corresponding 
to different ranges of a are shown in Fig. |6l For < a < |, Cne = B is a single point, which 
lies at the symmetric sum-rate point of C. For | < a < |, again Cne = B. Cne contains a single 
efficient point (the symmetric sum-rate point in C), but now there are additional interior points 
of C which may be achieved as a Nash equilibrium^ For | < a < 1, Cne is the intersection 
of the simplex formed by the sum-rate constraint of C and B. In this case, there are multiple 

7 In a slight abuse of terminology, we say that points in Cne can be "achieved as a NE." 
July 10, 2010 DRAFT 
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Fig. 6. Examples of Cne = C f~) B for a symmetric interference channel with normalized cross gain a. 

efficient points; in fact, the entire sum-rate face of C is included in Cne- For I < a < 2, C C B 
and so Cne = C. For 2 < a (not shown) C = B and so again Cne = C. Note that in all cases, 
the symmetric rate point is in C N e- 



C. Proofs 

To prove Theorem [Q we first show that points outside of B cannot be achievable as a Nash 
equilibrium, formalizing the intuition discussed earlier. We will then show that all points inside 
C fl B can in fact be achieved. 

1) Non-equilibrium points: 

Lemma 1: If (i2 1; R 2 ) G Cne. then Ri > Li = (n& — riij) + for i = 1, 2. 

Proof: User z's L, highest transmitted levels see no interference from user j's signal at 
receiver i. Hence, in any e-game, user i can always achieve a pay-off of Ri = Li (with zero 
probability of error) by sending Li uncoded bits, one on each of these levels, independent of 
user j's strategy. Thus for (i?i,i? 2 ) to be obtained as an r^-NE of an e-game for any e > 0, it 
must be that R t > Li — 77 for all i; otherwise, user i could deviate using the above strategy and 
improve his pay-off by 77. If (Ri,R 2 ) G Cne, then this inequality should hold for all 77 > 0. 
Taking the limit as 77 — > 0, the result follows. ■ 

Lemma 2: If (i2 1; R 2 ) G C N e> then for all i = 1, 2, R { < U it where Ui is given in (fTTI) . 
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Proof: Suppose (R%, R 2 ) € Cne- Without loss of generality, let us focus on user 1 to show 
that R 1 < U x . 

If ni2 — L 2 > /in, then C/i = ran and clearly Ri < ran, so there is nothing to prove. So in 
the following we can assume that 

ni2 -L 2 < nil- (12) 

Fix an arbitrary r\ > 0. Given a sufficiently small e > 0, there exist a (1 — e)-reliable strategy 
pair (si, s 2 ) achieving the rate pair (i?i, i? 2 ) that is also a ry-NE. As remarked in Section HH we 
can assume that in this nominal strategy pair, both users use a common block length N. Applying 
Fano's inequality to user 1 for the average bit error probability (see for example Theorem 4.3.2 
in ifTTTQ. we get the bound, for any block k: 

Rl < nmi 'f luJl) + 6 (13) 

where 5 depends on e and goes to zero as e goes to zero. Here, u\ denotes any randomness in 
xi, which recall is known at receiver 1. Note that we drop the block indices of the message and 
the signals to simplify notation. Now, 

— J(mi;yi|u>i) 

< ^(xijyilwO 

< ^(xi;yi) 

= ^[H(yx)-H{s 2 )\ 

< max(n u , n 12 ) j— 

where s 2 is the signal from user 2 that is visible at receiver 1. Here, the second inequality follows 
since u\ — xi — yi forms a Markov chain. Combining this with the above inequality, we get: 

R 1 < niax(n u ,n 12 ) - -j^H^) + 6. (14) 

We now seek a bound on H(s 2 ). Applying Fano's inequality to user 2, we get 

R2 < j-;I{ m 2]y2\U2) + 8 
< -J(x 2 ;y 2 ) + 5 
= ^^(u 2 ,v 2 ;y 2 ) + 5 

July 10, 2010 DRAFT 



14 SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 

where u 2 is the part of user 2's transmitted signal x 2 which is on the top min(L 2 ,n 12 ) levels 
and v 2 is the rest. The significance of u 2 is that it is received without interference at receiver 
2 and is visible at receiver 1 (i.e., part of s 2 ). Correspondingly, split user 2's received signal 

Y2 = (u 2 ,y 2 ). Now 



^(u 2 ,v 2 ;y 2 ) 
= J(u 2 ;y 2 ) + /(v 2 ;y 2 |u 2 ) 
= H(u 2 ) + /(v 2 ;y 2 |u 2 ) 
< #(u 2 ) + J(v 2 ; y 2 ) 

since u 2 — v 2 — y 2 forms a Markov chain. 

Combining this with the previous equation, we get: 

R2<^H(u 2 ) + ±I(v 2 ;y 2 ) + 8. (15) 

Let us now consider an alternative strategy s 2 for user 2. This encoding strategy has two 
independent sub-codes. The first sub-code transmits uncoded bits on the top min(L 2 , n\ 2 ) levels, 
achieving a rate of min(L 2 ,ni 2 ) bits per symbol time with zero error. The second sub-code 
transmits on the remaining n 22 — min(L 2 , n\ 2 ) levels. It codes over K blocks of length N each. 
Each codeword in this code has K components, each spanning N symbol times, for a total length 
of KN symbol times. Each codeword is chosen randomly, with i.i.d. iV-length components and 
each component chosen from the distribution of user 2's transmit signal v 2 under the original 
encoding strategy s 2 . Note that since user l's strategy s* codes only within blocks of length 
N and sends independent message across different blocks, the interference from user 1 is i.i.d. 
across such blocks. User 2 thus faces a memoryless channel from block to block. Standard 
random coding arguments apply and one can show that for any Si > 0, there exists a large 
enough K such that strategy s 2 can achieve a rate of I(v 2 ; y 2 ) — Si bits per block and with a 
probability of error of less than e. Thus, strategy s' 2 achieves a total rate R 2 bits per symbol time 
reliably, where 

R' 2 = min(L 2 , n 12 ) + -^[/(v 2 ; y 2 ) - <*i]. (16) 
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By definition of 77-NE, strategy s' 2 cannot perform much better than s 2 , i.e., R 2 + 77 > R 2 . 
Combining (fT6l) and (fl"5l) . we now have: 

^H(u 2 ) > min(L 2 , n 12 ) - 8 X /N - 8 - rj. (17) 

Essentially, we have shown that user 2 under strategy s 2 must be transmitting information 
at maximum entropy on these min{L 2 ,ni 2 ) levels by virtue of the fact that it forms a 77-NE. 
Substituting this into ([141) and observing that H (s 2 ) > H(u 2 ), we get: 

R x < max(nn, n 12 ) - min(L 2 , n 12 ) + 5i/N + 25 + 77. (18) 

Under the condition (fT2j) . one can readily verify that U\ = max(nn, ^12) — min(L 2 ,rii 2 ). 
Since 77, 5 and 5\ can be chosen arbitrarily small, we have shown that Ri < U\. The proof is 
complete. 

■ 

2) Achievable Nash Equilibria: From Lemmas \T\ and [2l it follows that C^e Q C fl B. In this 
section, we show that these two sets are in fact equal, proving Theorem [Q To do this we consider 
a modification of the class of Han-Kobayashi strategies presented in [2J. In these strategies, each 
user splits the transmitted information into two parts: private information to be decoded at only 
their own receiver and common information that can be decoded at both receivers. In Oil it is 
shown that a particular class of these strategies can achieve any point in the capacity region of the 
deterministic channel. The modification we make to these schemes is to allow each transmitter to 
include extra random bits in their common message. Next, we give some preliminary definitions 
related to Han-Kobayashi schemes and then formally define this class of strategies. 

For a given deterministic interference channel, let Xi denote the input alphabet of user i, 
i.e. this is the set of max(rijj,njj). We decompose this set as the direct product X ic x X ip , so 
that for any Xj G Xi can be written as Xj = (x ip ,Xj C ), where x ip denotes the (rtu — nji) + least 
significant levels of x i? and x ic consists of the ny t most significant levels. The significance of 
this decomposition is that the x ip consists of private levels for user i which are visible only at 
his receiver, while x ic consists of common levels that are visible at receiver j. 

We define a randomized Han-Kobayashi scheme for a given block-length N to be a scheme 
in which each each user i separates the message set {1, . . . , 2 Bi } into the direct product of a 
private message M. iv set containing 2 NRip messages and a common message set M. ic containing 
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2 NRic messages, where NR ip + NR ic = Bi. Additionally, each user i is allowed to have a 
random common message set Qj consisting of 2 NRir equally likely codewords; these can be 
thought of as NR ir random bits that the transmitter generates using the common randomness, 
which is shared with the corresponding receiver. The message sets are then encoded using a 
superposition code as follows. First the transmitter encodes the common and common random 
message via a map f ic : M ic xfl;4 X£, where the codebook is generated using an i.i.d. uniform 
distribution over the common levels. Next, the transmitter encodes the private message via a 
map f ip : M. ip x M. ic x Vti i— > X^l, where for each common codeword x ic , a different private 
codebook is generated using an i.i.d. uniform distribution over the private levels. Here, the 
common codeword x ic can be viewed as defining the cloud center and the the private codeword 
can be viewed as defining the cloud points. Transmitter i then sends the superposition of these 
two codewords. In the special case where Ri r = R 2r = 0, we refer to the resulting scheme as a 
non-randomized Han-Kobayashi scheme. 

We call a randomized Han-Kobayashi scheme (1 — e) -reliable if each user i can decode their 
own private and common messages with an average probability of bit error no greater than e. lj 

Next we specify an achievable rate region for this class of schemes. This characterization is 
in terms of modified MAC regions for each of the two receivers. Specifically, the modified MAC 
region at receiver i, 1Z™, is the set of rates (R ic , R ir , R ip , R jc , R jr , Rj C ) that satisfy: 

Ric + Rip + Rjc + Rjr 5: HidJiyTln, Tlij) 

Rip H - Rjc ~H Rjr ^ max(7ijj-, [na f^ji) ) 



(19) 



^Hp _ {Jin ^ji) 



^ic i -*Hp _ 'Hi 

The modified MAC region is derived by considering the MAC channel at receiver i consisting 
of three transmitters one corresponding to user i's own common message, one corresponding 
to user i's own private messages, and one corresponding to the combination user j's common 
and common random messages. Here, user z's own common random signal can be ignored since 
it is known at receiver i and so can be removed. Likewise, user j's private message can be 

8 This is slight strengthening of the previous definition of a reliable strategy, which only required the overall average bit error 
probability to be no greater than e. Hence, an agent's pay-off in a e-game under a (1 — e)-reliable Han-Kobayashi scheme is 
again their rate. 
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ignored since it is not received at receiver i. The capacity region of this three user MAC will 
have seven constrains including the first four given in (fT9l) . The modification to this is that we 
drop the remaining three constraints by following similar arguments as in lfT2ll . First, recall that 
a constraint for a MAC region that involves the rates {Ri : i E Ai} for some subset of the users 
M. corresponds to a bound on an error event where the message for each user in M. is in error 
and all other messages are correct lfT3l . The missing bounds correspond to error events that we 
ignore for one of the following two reasons. First, due to the use of superposition coding we 
can ignore constraints which correspond to making an error in the common message but not 
the private message. Second, from the point-of-view of user i, we can ignore the constraint that 
corresponds to an error in only user j's signal. 

From the above discussion and following similar arguments as in 0, we then have the 
following characterization of the rate-tuples that be achieved with this class of randomized 
Han-Kobayashi schemes. 

Lemma 3: TZrhk = TZ™nTZ™ is an achievable region for randomized Han-Kobayashi schemes. 

If a rate-tuple is in TZrhk, receiver i may not be able to reliably decode user j's common 
and common random messages. In particular, this must be true if Rj C + Rj r > n^. However, if 
R ic + R ip > Li for i — 1, 2, then the next lemma shows that this will be possible. 

Lemma 4: Any rate-tuple (Ri c , Rir, Ri P , R2c,R2r, R2 P ) in the interior of TZrhk with R ic + 
Ri P > Li for i — 1,2 can be achieved by a randomized Han-Kobayashi scheme in which each 
user i decodes user j's common and common random message (with arbitrarily small probability 
of error). 

Proof: First note that if a rate tuple is in the interior of TZrhk with R ic + R ip > Li = 
(nn — 7iij) + , then from the first constraint in (Tf9l) for receiver i, it follows that 

Rj C + Rj r < riij. (20) 

Now consider a randomized Han-Kobayashi scheme which achieves this rate tuple. After user i 
decodes his own private and common messages, he will have a clean view of user j's common 
message. Moreover, from the above constraint, the rate of this message is less than the capacity 
of the channel from user j to receiver i and so there must exist a randomized Han-Kobayashi 
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< 



scheme in which user i can also decode user j's common messages with arbitrary reliability. 



A given rate tuple R = (Ri c , Rir, Rip, -R20 R2r, R-2p) is defined to be self- saturated at receiver 
i if R G 1Z™ at receiver i, but any other choice of R ic , R ir and R ip with a larger value of R ic +R ip 
(keeping all other rates fixed) will result in a rate-tuple that is not in 1ZJ 1 . Clearly, a self- saturated 
rate-tuple must lie on the boundary of the modified MAC region at receiver i. Additionally, the 
constraints in (fl9l) that are tight at this point must involve both R ip and R ic . If a rate-pair is 



self- saturated and R ip + R ic > Li, then it will be useful to think about this in the context of a 
second MAC region at receiver i in which there are only two users, one corresponding to user 
i's entire message (at rate Ri = R ic + R ip ) and a second that again corresponds to the common 
and common random messages sent by user j (at rate Rj C + Rj r ). This MAC region is given by 

Ri + Rj C + Rj r < max(njj, riij) 

Ri < nu (21) 

It can seen that if a rate tuple is self- saturated for user i and satisfy Ri C + Ri P > Li, then the 
rates Ri and Rj C + Rj r must be in (|2T|) and if Ri is increased by any amount this will no longer 
be true. We use this to show that if a user is self- saturated and his rate is greater than Li, then he 
can not deviate and improve his pay-off. The key idea here is that if a user could improve, then 
he will violate one of the MAC constraints in ((IT)) . This cannot be possible since after deviating 
and decoding his own message, he should still be able to decode the other user's message. The 
next lemma formalizes this argument. 

Lemma 5: If a rate tuple (-Ri c , Rir, Rip-, -R20 R2r, R2 P ) is self- saturated with R ic + R ip > L t 
for both both receivers i, then (R lp + R lc , R 2p + R 2c ) £ C NE . 

Proof: Given a rate tuple R = (i?i c , R\ r , R\ P) i?2c, R2r, R2 P ) that is self- saturated at both 
receivers and with R ic + R ip > Li, it follows from Lemmas [3] and @] that for any r] > 0, and 
any e > 0, there exists a randomized Han-Kobayashi scheme achieving rates (R lc — r//6, R\ r — 
77/6, R\ p — 77/6, i?2c — T7/6, i?2r — T7/6, i?2 P — 77/6) for which each receiver can decode both his 

9 The Han-Kobayashi scheme under consideration may suffice, however if this scheme does not provide a low enough 
probability of error, then a new scheme that achieves the same rate-tuple with the desired probability of error can be found 
(perhaps by using a longer blocklength). 
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own common and private messages as well as the other users common and common random 
messages with probability of error less than e. 

Next we argue that for e small enough such a pair of strategies must be a ?7-NE of a e-game. 
First note that under these nominal strategies each user i will receive a pay-off of R ic + R ip — r]/3. 
Assume that these strategies are not an equilibrium, and without loss of generality suppose that 
user 1 can deviate and improve his performance by at least 77. After deviating, the rates for the 
MAC region at user 1 in (|2T|) are given by R = (i?i, R 2c + i?2r — ^/3), where Ri > Ri + 277/3. 
Since the rate tuple R is self- saturated, it follows that after this deviation, the rates R must 
violate either the first or second constraint in ((21")) for i = 1 by at least 77/3. 

Suppose that user 1 deviates to a blocklength iVi strategy. Then using Fano's inequality (as in 
(fl"3l ) for the average bit error probability and following the usual converse for a MAC channel, 
it must be that 

Ai < Axi;yi|x 2c ) + ^ (22) 

Ni 

where 5 goes to zero as the average bit error probability e does. In particular, choosing e small 
enough so that 5 is less than 77/3, then (|22)) implies that 

R\ < nu + 77/3. 

Hence, the second constraint in (12D) can not be violated. 

Likewise, since in the nominal strategy for user 1, he was able to decode user j's common 
and common random signals, it follows that 

Ric + R2 P < /(X2 " yi) + 5> (23) 

i 

where N- denotes the block length used in the nominal strategy. Combining ((22)) and d23l and 
choosing e small enough so that 5 + 5' < rj/3, we havd_ 

Ri + R 2c + R2 P < max(njj, n^) + 77/3 (24) 

which shows that the first constraint in (ED can not be violated. 



10 Note, as discussed in Section [n] we need to replace {22} and {23} with the corresponding expressions over super-blocks 
whose length is the least common multiple of Ni and N^ so that that both equations are over the same block-length. 
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Fig. 7. This figure shows the interference free levels for each transmitter in the interference channel from Fig. [4] The levels for 
user i are indicated at that user's receiver by either a "a" or a "b". The levels labeled with a "a" correspond to "private levels," 
which are accounted for in ( 125b . The levels labeled with a "b" correspond to common levels, which are accounted for in l !26t . 



Therefore, such a deviation cannot exist and the nominal strategy must be a 77-NE for small 
enough e. Taking the limit as 77 — > 0, it follows that the desired rates must lie in Cne- ■ 

To prove that Cne = C fl B, we will show for that any rate-point (R 1: R 2 ) G C fl B, there 
exists a feasible rate tuple in IZrhk with Ri = Ri C + Ri V for % = 1, 2 and that is self- saturated 
at both receivers. The desired result then follows directly from Lemma |5] As a first step toward 
doing this, we define a class of non-randomized Han-Kobayashi rates (Ri c , Ri P , R2C, R2 P ) at 



which each transmitter is fully utilizing its "interference-free" levels, i.e., the L, 



I 'vii I ij 



most significant levels at transmitter i. Depending on the channel some of these levels may be 
common and some may be private. Specifically, there are 



"i \ tuti ji ij / 



private interference free levels at user i and 

h = (ria - max(njj - n jh n i:j )) + 

common interference free levels at user i. An example of these is shown in Fig. U\ We say that 
(Ric, Rip, i?2c, R-2p) fully utilizes the interference free levels for user i if 



±Hp 1— &i 



Ric > hi. 



(25) 
(26) 
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Fig. 8. An example of a non-randomized Han-Kobayashi scheme for a symmetric channel with na — 3 and ny = 2. Here 
each user is using the rate split Ri C — 1 and Ri P — 0, which fully utilizes the 1 interference free-level at each transmitter. This 
rate split is not self-saturating at either transmitter. 



Lemma 6: If (R\ Cl Ri p , R 2c , Rip) fully utilizes the interference free levels for each user i, 
then there exists random common rates Ri r ,R 2r > such that (R\ c , R\ r , Ri p , Rici Riri R2 P ) is 
self- saturated at both receivers. 

Proof: The intuition is as follows. If R ip > a t and R{ C > bi, then all the interference-free 
levels are saturated at receiver i (i.e., at maximum entropy). The remaining mj levels are all 
reachable by the common signal from user j. By putting sufficient number of random bits on 
that common signal, these n^ levels can be fully saturated as well. 

More rigorously, we will show that one can always increase R 2r such that the overall sum 
rate constraint (the first constraint in (fT9l) ) is tight, so that receiver 1 is saturated. Suppose no 
such choice of R 2r exists. Then, it must be that R 2r cannot be further increased because the 
second constraint in (fT9l) for receiver % is tight. However, if this constraint is tight, then since 
R\c > 6«, it can be seen that the first constraint at receiver i must also be tight. ■ 

As an example of the construction used in the proof of Lemma [6] consider a symmetric channel 
with nn = n 22 = 3 and rii 2 = n 2 \ = 2 as shown in Fig.[8l Each user has 1 interference free level 
with Oj = and bi = 1. Thus the non-randomized Han-Kobayashi rates given by Ri c = R 2c = 1 
and Rip = R 2p = fully utilize the interference free levels at each receiver, but is not self- 
saturating since, each transmitter could increase Ri P by one. However, if each transmitter sets 
Ri r = 1, the resulting randomized rates will be self- saturated as shown in Fig. |9] 

It follows from [3J that for any rate pair in COB, there exists a non-randomized Han-Kobayashi 
rate-split that satisfies Lemma [3l If these Han-Kobayashi rates fully utilize the interference- 
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Fig. 9. A randomized Han-Kobayashi scheme which achieves the same rates as the non-randomized scheme in Fig. [9] but is 
self-saturated. Here we do not show Ri r at receiver i since this signal can be removed from the assumed common randomness. 
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Fig. 10. An example of an alternative non-randomized Han-Kobayashi rate-split that achieves the same rates as the scheme in 
Fig. [U but does not fully utilize the interference-free levels. 



free levels then we are done. Unfortunately, not all non-randomized Han-Kobayashi rates fully 
utilize the interference-free levels. For example consider the symmetric channel in the previous 
paragraph. An alternative non-randomized Han-Kobayashi rate-split is given by R lc = R 2c = 
and Ri p = R 2p = 1 (see Fig. [TO]). These rates do not fully utilize the interference-free levels 
and cannot be made into an equilibrium by simply increasing the users' common random rates. 
Though this set of rates do not fully utilize the interference-free levels, as the previous example 
illustrates, there is another set of non-randomized rates that do. The next lemma generalizes this 
example. 

Lemma 7: Given any point (R 1 ,R 2 ) £ C fl B, then there exists a non-randomized Han- 
Kobayashi rate split that fully utilizes the interference free levels at each transmitter. 

Proof: To prove this lemma we begin with an arbitrary non-randomized Han-Kobayashi 
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rate- split that satisfies Lemma [3] and show that this can always be transformed into one that 
fully utilizes the interference free levels at each transmitter. A key point here is that a» + 6; = L { , 
so that for any point in B there will always be sufficient amount of "rate" available to meet the 
constraints in (|25l ) and (l26t . 

First we show that if R ip < ai for either user i, then we can always increase R ip and decrease 
R ic by the same amount until R ip = Oj. The only way such a transformation could not be done 
is if the second constraint in (fT9l) at receiver i prevented it. But by combining (l20l) at receiver j 
and the second constraint at receiver i, it can be seen that this will never happen for R ip < Oj. 

Thus we can assume that R ip > Oj. Given this if a rate-pair does not fully utilize the 
interference free levels at transmitter i, it must be that R ic < 6j. Suppose that this is true for 
receiver 1 and consider increasing R lc and decreasing R tp by the same amount until R lc = b\. 
Note that since ai + b\ = L\ and R ic + R ip > L\, when we decrease R\ p in this way it will 
never cause it to become less than ay. Changing R lp and i? lc in this manner will not violate 
any of the constraints in (fl9l) at receiver 1, since every constraint involving R lc also involves 
Ri p . If this can be done without violating the first or second constraints at receiver 2 then we 
are done. Otherwise, it must be that at least one of these constraints becomes tight when R lc 
reaches the value R[ c = bi — A, for some A > 0. Note that 

i?2p + Ric + R\ c = R2 + Rlc 

<U 2 + b 1 -A (27) 

= max(n 2 2,n 2 i) - A 
and so the first constraint at receiver 2 can not be tight. This implies that the second constraint 
at receiver 2 must be tight, i.e., 

Rip + Rlc = max(n 2 i, n 22 - n l2 ). (28) 

Combining this with (|27T) we have 

R 2c < max(n 22 , n 2 i) - max(n 2 i, n 22 - n 12 ) - A 

= h - A. 

It then follows that R 2p > a 2 + A. In other words user 2's interference free levels must be 
"underutilized" by at least as much as user l's. 
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Now consider increasing R lc from R\ c by A while simultaneously reducing _R lp and R 2p 
each by A and also increasing R 2c by A. The above calculations show that no constraint will 
be violated if we only changed i? lc , i? lp and R 2p in this way. Likewise, by applying the same 
argument to R 2c , R2 P and Ri p , changing these values will not violate any constraints. The only 
possible violation could occur in the first constraints at either MAC, which involves both R lc 
and R 2c . However this constraint also involves one of the users' private rates, and so cannot be 
violated by the same argument as in (1271) . After this transformation, the resulting rate-split will 
fully utilize the interference free levels at both receivers. ■ 

Combining Lemmas [51 [6] and [71 we have proven Theorem [Q 

We also note that by direct calculation it can be shown that Cne always contains at least 
one efficient point, i.e., one point that is sum-rate optimal. Indeed it can be shown that for 
a symmetric channel, for a < 2/3, the only efficient point in Cne is the symmetric sum-rate 
optimal point, while for a > 2/3 all sum-rate optimal points are in Cne- 

IV. The Gaussian IC 

In the previous section, we completely characterized the Nash equilibrium region for the two- 
user linear-deterministic IC. In this section, we show that an analogous result holds for the 
Gaussian channel model within a one bit approximation. 

A. Gaussian Channel Model 

Here, our goal is to characterize rates in Cne for two-user Gaussian interference channels 
represented by (see Fig. [Q) 

2/i = hnxx + h 12 x 2 + z 1 

(29) 

y 2 = h 2 i%i + h 22 x 2 + z 2 

where for i = 1,2, Z{ ~ C/V(0, 1) and the input Xj G C is subject to the power constraint 
E[|xj| 2 ] < P. Following [QQ|, for % = 1,2, we parameterize this channel by the signal-to-noise 
ratios SNRj = P\hu\ 2 and the interference-to-noise ratios INRy = P\hij\ 2 . 

The characterization of Cne in the linear deterministic case relied on knowing the exact 
capacity region C for the deterministic IC and that any point in this region can be exactly achieved 
by a non-randomized Han-Kobayashi schemes. For the Gaussian IC, C is only known in the case 
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of very weak [fT5l - [fT71l or very strong interference Q, IfTSTl . Otherwise, C is not known exactly 
but in [HI it is characterized to "within one bit" for all parameter ranges. Furthermore, HI shows 
that in a general Gaussian IC, we can achieve any point within one bit by a non-randomized 
Han-Kobayashi scheme. These one-bit gaps will effect how accurately we can characterize Cne 
in the Gaussian case. Namely, in general we will also be able to characterize this region only 
to within a one bit gap (though for particular channels this gap may be smaller). 

B. Main Results 

For the Gaussian IC our main result is to show an analogue to Theorem Q] that characterizes 
Cne to within one bit. In this case we will give both an inner bound and outer bound on Cne- Both 
of these bounds will be given in terms of a capacity region and a "box" as in the deterministic 
case. The true capacity region will be used for the outer bound, while an achievable "Han- 
Kobayashi" region, Chk, will be used for the inner bound. Here, Chk corresponds to the set 
of rates that are achievable using the specific class of Han-Kobayashi schemes in [1J (this will 
be defined more precisely in Sect. IIV-C2I) . This region is within 1-bit of the capacity region C, 
i.e. if {R u R 2 ) e C, then ((i2 x - 1)+, {R 2 - 1)+ e C HK . 

The box B used for the outer bound is given by 



B = {{Ri, R 2 ) :Li<Ri< U h V* = 1, 2}, 



where for each user i = 1, 2 



Li := log 1 



SNRj 
1 + INR, 



and 



f, / ,.*.« ,-ur, x , ( fSNR 7 -max(INR 7i ,SNR 7 /INR i7 )] H 

Ui = min <^ log 1 + SNR, + INR 4i -log 1+ [ - l [' ? ^ , 

^ \ 1 + \NRji + max(INRji,SNRj/INRj : ,-)/ r^O) 

log(l + SNR,)}. 
While the inner bound is given in terms of the "box," 

BT = {(R 1 , B^) : L t < R { < max(C/ i - 1, L { ), Vi = 1, 2}, 

which differs from B by at most one bit. 

We next state the analogous result to Theorem [TJ 

July 10, 2010 DRAFT 



26 SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 

Theorem 2: C HK C\B~ C C NE Q COB. Moreover, for a Gaussian IC with strong interference, 

Cne = Chk n B. 

In certain cases, when we know additional properties of the capacity region we can strengthen 
these results. For example for very weak interference, from the results in lfT5l - lfT71 it is known 
that the maximum sum-rate in C is achieved by simply treating interference as noise, which is 
also in Chk- This corresponds exactly to the lower- left corner of B and B~ . Hence, Theorem [2] 
implies that Cne contains the single point (Li, L 2 ) and thus in this case Cne is characterized 
exactly. 

We also note that the bounds in Theorem [2] can be shown to be within a constant gap of the 
bounds given in Theorem [Q for a related deterministic IC, which is obtained by the mapping 
nu = Llog(SNRi)J and ny = [logONR^-)]. 

In the next section we will give a proof of Theorem [2] that is based on generalizing each of 
the steps we used in the deterministic case. 

C. Proofs 

1) Non-equilibrium points: We begin by showing that certain rate-pairs can not be in Cne- 

Lemma 8: If (R u R 2 ) G C NE , then R { > L t : = log(l + jf^) for i = 1, 2. 

Proof: Regardless of user j's strategy, user i can always achieve at least rate log(l + tt^jr-) 
(with arbitrarily small probability of error) by treating user j's signal as noise. Hence, this is 
always a possible deviation for user i in any e-game. Thus user i's rate in any 77-NE must be at 
least Li — rj. ■ 

The bound in Lemma [8] is a direct analog to the bound in Lemma [TJ for the linear deterministic 
channel, which characterizes the lower bounds of the box B. The next lemma gives an upper 
bound corresponding to the bound in Lemma [2l 

Lemma 9: If (i? 1? R 2 ) E C NE , then R { < U-i, where Ui is given in (|30l) . 

Proof: Suppose (R%, R 2 ) G Cne- Without loss of generality, let us focus on user 1 to show 
the upper bound on R 1 . 

We define first a parameter: 

2 /1NR21 1 \ „,, 

Consider first the case that 0^ > 1: this corresponds to the case in the deterministic channel 
when the interference from the signal user 2 transmits at its interference-free levels appears 
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below noise level at receiver 1. In this case, there will be no minimum amount of interference 
that user 2 will cause to user 1 at a NE, and we simply bound R± by its point-to-point capacity: 

Ri < log(l + SNRi). (32) 

The case when a v < 1 is more interesting and we need a tighter bound on R 1 . Fix r\ > 
and arbitrary. Given a sufficiently small e > 0, there exist a (1 — e)-reliable strategy pair (s*, s^) 
achieving the rate pair (Ri, R 2 ) that is also a 77-NE. As remarked in Section HH we can assume 
that in this nominal strategy pair, both users use a common block length N. Applying Fano's 
inequality to user 1 for average bit error probability, we get the bound, for any block k: 

Rt < Hmi >* lM + 5 (33) 

where yi is user l's received signal over the block, 5 depends on e and goes to zero as e goes 
to zero, and u>i denotes any common randomness in Xi. Note that we drop the block indices of 
the message and the signals to simplify notation. Now, 

— I(mi;yi|wi) 

< -^/(xijyilwi) 

< ^(xi;yi) 

= ^Kyi)-Myi|xi)] 

= j^[h(yi)-h(z 1 )-h(yi\x 1 )+h{z 1 )] 

< log(l + SNRi + INRi 2 ) - ilX>: y ' 



N 
where 

yi := /ii 2 x 2 + zi. 

Combining this with the above inequality, we get: 

R 1 < log(l + SNR! + INR 12 ) - /(X ^ l) • (34) 
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The term J(x 2 ; yi) plays the role of H(s 2 ) in the linear deterministic case. We now seek a 
lower bound on I(x 2 ; yx). Applying Fano's inequality to user 2, we get 

R2 < j-;I{ m 2]y2\U2) + 8 

< -/(x 2 ;y 2 ) + 5 

= ^(u 2 ,v 2 ;y 2 ) + <5 

where 

u 2 = x 2 + v 2 

and v 2 ~ CJ\f(0, <jIIn) independent of everything else, with a% defined as in (f3Tb . 
Now, 

^(u 2 ,v 2 ;y 2 ) = I(u 2 ;y 2 ) + /(v 2 ;y 2 |u 2 ) 
= ^(u 2 ;y 2 ) + /(v 2 ;y 2 |u 2 ) 
< ^(u 2 ;y 2 ) + /(v 2 ;y 2 ) 

where 

y2 = y2 - h 22 u 2 = h 22 y 2 + /121X1 + z 2 

and the last inequality above follows from the Markov chain u 2 — v 2 — y 2 . 
Combining this with the previous equation, we get: 

R2 < ^/(u 2 ; y 2 ) + ^/(v 2 ; y 2 ) + 5. (35) 

Let us now consider an alternative strategy s 2 for user 2: a superposition of two i.i.d. Gaussian 
codebooks, one with each component of each codeword having variance 1 — <r%, and one with 
each component of each codeword having variance a\. The codes have block length NK. If we 
choose K — > 00, then standard random coding argument and the chain rule of mutual information 
implies that this scheme can achieve a rate of: 

— I(u 2 , v 2 ; y 2 ) = ^(u 2 ; y 2 ) + ^ J ( v 2! ^2), 
where u 2 ~ CA/"(0, 1 — cr^Jjv) and u 2 and v 2 are independent, and 

y 2 = h 22 (u 2 + v 2 ) + /i 2 ixi + z 2 . 
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We have: 



^>M^ ^m^k) < 



using a worst-case Gaussian noise argument GOl on v 2 and xi. This implies from (1351) that 

by definition that we are operating at a 77-NE. 

Next we relate J(x 2 ;yi) to 7(u 2 ;y 2 ) and complete the argument. 

^(x 2 ;yi) 
= J(x 2 ; h 12 x 2 + zi) 

= I(x 2 ;x 2 + Zi), zi ~ CM(0, -==I N ) 

VllMK 12 

r 2 _ ™„„/INR 2 i 1 



> J(x 2 ;x 2 + v 2 ), since a 2 v = max(^, ^) > ^ 

= J(u 2 ,x 2 ) 



> ^(u 2 ; y 2 

> N 



S V l + SNR 2 a t 2 + INR 2i y 'J "— ' 

Substituting this into (|34l) . we get the final result: 

Rl < log(l + SN Rl + INR M ) - log (l + i ^2^ ) + , 

1 n-i-QMR imp ^ 1 A SNR 2 -max(INR 21 ,SNR 2 /INR 12 ) , 

= log(l + SN Rl + INR 12 ) - log (l + 1 + |NR2i+max(|NR2i;SNR2/|NRi2) ) '/• 



Combining this with inequality (1321) and letting 77 — >• yields the desired result. ■ 

2) Achievable Nash Equilibrium: The lemmas in the previous section provide an outer bound 
on Cne- In this section we give an inner bound on C NE by showing that this set contains Chk^B~ . 
Motivated by the deterministic analysis, we again consider a modified Han-Kobayashi scheme in 
which each user may send a private message, a common message, and also a common random 
message that is generated using the common randomness they share with their own receiver. 
Additionally, in the Gaussian case, we allow a user to also send a private random message 
using their common randomness. In the deterministic case, sending such a message would not 
serve any purpose since a user's private signal does not appear at all at the other receiver. In 
the Gaussian case, a user's private signal is present at the other user and the private random 
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message is used to ensure that the effect of this signal is essentially the same as "noise." All of 
these messages are again encoded using a superposition code, which we define formally next. 

For a given Gaussian IC, let P, ip and P ic denote a user's private and common power respectively, 
where P ip + P ic = P. As in (H, we assume that Pi P is set as follows: 

{min(l, INRA if INR„ < SNR, 
0, otherwise. 

Let INR^ = \hji\ 2 P ip denote the INR at receiver j due to this choice of P ip and let SNR? = 
\hu\ 2 Pi P denote the corresponding SNR at receiver i. Note that when SNRj > INRjj > 1, the 
received interference power at receiver j due to user i's private power is at the noise level. 

As in the deterministic case, we define a randomized Han-Kobayashi scheme to be one in 
which each user i separates their message set into M. ip x Mi C with rates R ip and R ic , respectively, 
and also generates a random common message set Vt ir with rate Ri r . Additionally, we allow each 
transmitter to generate a random private message set, £l is with rate Ri S . These messages are 
then encoded using a superposition code as follows. First, the transmitter encodes the common 
message m ic E M. ic and common random message tUi r E VL ir into a codeword x ic (mi C , tOi r ) from 
a codebook that satisfies the average power constraint of P ic . Given this codeword, it encodes the 
private message m ip and private random message u is E il is into a codeword x. ip (m ip , u is , x ic ) 
from a codebook that is indexed by the common codeword x ic and satisfies the average power 
constraint of P ip . It then transmits the superposition x; = x ic + x ip . As in the deterministic case, 
we call such a scheme (1 — e) -reliable if a user is able to decode both his common and private 
messages with reliability of (1 — e). 

We again introduce a modified MAC region 1Z™ for each receiver i that we will use to 
characterize the rates achievable by such a scheme. This is the set of rate tuples that satisfy: 



Ric + Rip + Rjc + Rjr < log I 1 



SNR, + INR^ - INRf 



INR?. + 1 



SNRf + INR i7 -INRf 1 
R ip + R jc + R jr <log[l + - ' 



INR? + 1 



SNR : 

Ri P < log ( 1 4 



Ric + Rip < lo£ 



INR?. + 1 

SNRi 
INR?. + 1 



(37) 
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As in the deterministic case, these constraints arise from considering the three user MAC region 
at receiver 1 corresponding to the rates R ic , R ip and Rj C + Rj r . Using these regions we then 
have the following characterization of rate-splits that can achieved with this class of schemes. 

Lemma 10: TZrhk = TZ™ H TZ™ is an achievable region for randomized Han-Kobayashi 
schemes. 

We define the Han-Kobayashi region Chk in Theorem [2] as the set of rates (Ri, R 2 ) for which 
there exists a rate split (Ri c , Ri r , Ri p , R ls , R 2c , R 2r , R 2p , Ru) £ TZrhk with Ri = R lc + R lp 
and R 2 = R 2c + R-z P - Using [1J, it follows that Chk is within one-bit of ClUJ Next we give an 
analog to Lemma @J 

Lemma 11: Any rate-tuple (R lc , R ir , Ri p , Ru, R 2c , R 2r , R 2p , R 2s ) in the interior of TZrhk 
with R ic + Rip > Li for i — 1, 2 can be achieved by a randomized Han-Kobayashi scheme 
in which each user i decodes user j's common and common random message (with arbitrarily 
small probability of error). 

The proof here follows exactly the same steps as in the deterministic case. In particular for 
R ic + R ip > Li, note that 

R je + R jr < log (^1 + YTM*r ) (38) 

which implies that if user i can decode his own common and private messages, he will be 
receiving user j's common messages at a rate less than the capacity of the channel over which 
these messages are sent. 

Note also that the private random rate R is does not show up in any of the constraints for TZrhk- 
This is because in these constraints each user i is treating the other user's private message as 
worst-case noise with power INRf and can remove their own random private message. The next 
lemma shows that the random private rate can always be chosen so that there is essentially no 
loss in this assumption. 

Lemma 12: Given any 8 > and any rate tuple in TZrhk with 

R JS = (\og(l + \NR^)-R jp -5/2)+ 

"The rate region studied in [1] corresponds to the rates Ri and R2 that can be achieved with rate-splits in TZrhk where 
the common random and private random rates of both users are zero. It can be seen that the resulting region is equivalent to 
Chk as defined here. 
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then for a large enough block-length N, this rate tuple can be achieved by a randomized Han- 
Kobayashi scheme such that 

^h(h^ + Zl ) > log(7re(l + INR* )) ~ 6. 

Proof: Given a rate tuple that satisfies the conditions of this lemma and a constant 5 > 0, 
we next describe a specific encoding of user j's private messages to ensure the conditions for 
this lemma hold true. Let Wj = (mj P , Uj S ) denote the total private message to be encoded by 
user j (chosen from a total private codebook with rate Rj P + Rj S ). To encode this messageo we 
consider the following two cases: (i) R jp < log(l + INR?) - 5/2 and (ii) R jp > log(l + INR|). 
In each case we will separate Wj into two messages so that Wj = (whw?). 

Case 1: Rj P < log(l + INRf ) — 5/2. In this case we set wj = m,j p , i.e. this is the private 
message which is to be decoded at receiver j. Since the rate-tuple is in TZrhk, this message 
must be decodable over a Gaussian channel with a capacity of log(l + SNR^). We then set 
wjojjs, i.e., this is the private random message sent by user j. By assumption this message will 
have a rate of R js = log(l + INR?-) - R jp - 5/2. 

By choosing N large enough, there will exist a Gaussian broadcast codebook for these 
messages so that for a given reliability, wj and w| can be received reliably over the Gaussian 
channel given by 

y = hijX 1 - + Zi 

where x^ has average power Pj P and the noise variance is 1, and wj can be received at user 
j's receiver given Wj (equivalently given the private random message ujj S ). Note that the first 
channel has a capacity of log(l + INRf ). 

By applying Fano's inequality to the first receiver, we have that for a large enough reliability 
we can find a block-length iV so that 

JV(log(l + INRP ) - 5/2) < I(w 3 ; y) + N5/2, 

where y = hyx? + z x denotes the received signal over a block of length N. 

12 To keep the overall superposition code structure for our class of Han-Kobayashi schemes, we need to construct such a 
private codebook for each codeword Xj C in user j's common codebook. Here we focus on one such codebook. 
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Now, 



Hence, we have 



J ( w i;y) = My) -N\og(ne). 



h(y)>N(\og(ire(l + \NR p ij ))-5) 



as desired. 

Case 2: Rj P > log(l + I N Rf ) . In this case we set Rj S = and choose w l - and w 2 so that 



rrij P = (w 



p w 2 ) where iu] is chosen from a code book with rate log(l + INRf ) — 5/2 and w 2 is 
chosen from a codebook with rate Rj P — log(l + INR| '■) + 5/2. 

By choosing N large enough, there will exist a Gaussian broadcast codebook for these 
messages so that for a given reliability, wj and w 2 can be received at user j's receiver, and 
given w 2 , wj can be received reliably over the Gaussian channel 

y = h^ + Zi. 

Applying Fano's inequality at the second receiver we have 

NR jp <I( Wj ;y : w 2 ) + N5/2. 



Now, 



Hence, we have 



I(wj] y, w 2 ) = I(w; w 2 ) + I(w; y\w 2 ) 

= N(R JP -\og(l + \NR^) + 5/2) 
+ h(y\w 2 )-N\og(Tre). 

h(y\wj 2 )>N(\og(ne(l + \NR^))-5). 



Dropping the conditioning and dividing by N, it follows that 

1 
N' 

as desired. 



: / i (y)>log(7re(l + INR^ 



Note that under the given power constraints, iVlog(7re(l + INR| '•)) is the maximum possible 
value for h(y) which is achieved when y is a sequence of i.i.d. Gaussian random variables. 
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Hence, this lemma can be viewed as showing that when the private rates are sufficiently high, 
h(y) is well approximated by simply viewing y as i.i.d. Gaussian. 

We say that a rate- split R is self saturated at receiver i if R 6 W^ and any other choice 
of R ic and R ip in which R ip + R ic is increased (keeping all other rates fixed) will result in a 
rate-split that is not in 1Z™. Similar to the deterministic case, it can be shown that if receiver 
i is self- saturated and Ri C + Ri P > Li then Ri = R ip + R ic and Rj C + Rj r must be inside the 



following two user MAC region: 



Ri + Rj c + Rj r < lo£ 



SNRi + \NRij - INR^. 



INRJ + 1 



SNR, 



^ < lo S ( 1 + .mop - 1 ) (39) 



Rjc + Rjr < log 1 



INR^-t I 



INR i3 - INRP 

1 + INR?. 



Moreover, if Ri is increased then this rate pair will no longer be in this region. Using this we 
have the next lemma which gives an analogous result to Lemma [5] for the deterministic channel. 
Lemma 13: If there exists a rate tuple R that is self- saturated with R ic + R ip > Li for both 
both receivers i, then (R lp + Ri c , R 2p + H 2c ) G Cne- 

Proof: The proof follows a similar argument as that for Lemma [5l Given a rate-tuple 
R = (Ric, Ri r , Ri p , Ri s , R 2c , R 2r , R2 P , R2s) that satisfies the conditions in the lemma, then it 
follows from Lemmas [RE [EH and [[2] that for any r] > and e > 0, there exists a randomized 
Han-Kobayashi scheme achieving rates (Ri c — 77/6, Ri r — 77/6, R lp — r//Q, _R ls , R 2c — r//6, i?2r — 
77/6, _R 2p — 77/6, i?2s) for which each receiver can decode his own common and private messages 
as well as the other user's common and common random messages with probability of error 
less than e. Moreover, by possibly changing the private random rates i? ls and R 2s to satisfy 
Lemma [12] such a scheme can be found for which 

^Khirf + zx) > log(7re(l + INR?.)) - v/Q, (40) 

for each user i. 

Next we argue that for e small enough such a pair of strategies must be a 77-NE of a e-game. 
Assume that these strategies are not an r/-NE, and without loss of generality suppose that user 
1 can deviate and improve his performance by at least 77. After deviating, the rates for the MAC 
region at user 1 in (|39l) are given by R = (Ri,R 2c + R 2r — r]/3), where Ri > Ri + 277/3. After 
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this deviation, the rates R must violate either the first or second constraint in (|39l) for i = 1 by 
at least r]/3. 

Suppose that user 1 deviates to a blocklength N strategy, which without loss of generality we 
can assume is the same as the original strategy. Then from Fano's inequality for the average bit 
error probability it must be that 

^^ J(x 1 ;y 1 |x 2e ) +(5 (41) 

where 5 goes to zero as the average bit error probability e does. Note that 
^(xi;yi|x 2c ) 1 (U . , , ( , v 

n = jv^( yi l X2c ) ~ Myil x i» x 2c) 

< log(7re(l + SNRi + INR? 2 ) - log(7re(l + INR? 2 ) + 77/6 
, ( SNR i \ 

where the second line follows from (|40l) . Choosing e small enough and combining this with (|4T1) 
implies that 

Rl < log I 1 + rrm^) + "< 3 - 

Hence, the second constraint in (|2TT) can not be violated. 

Likewise, since in the nominal strategy user 1 was able to decode user j's common and 
common random signals, it follows that 

R 2c + R 2P < I -^p± + 5'. (42) 

Combining (|41j) and (l42l) and choosing e small enough so that 5 + 5' < 77/6, we have 

R~! + R 2c + R 2p < j^H^c, xi; yi) + 77/6 

< log(vre(l + SNRi + INR 12 ) - log(vre(l + INR? 2 ) + r]/3 
( SNR 1 + INR 12 + INR^ 

= lo H 1 + — tttn^ — ) +v/3 

which shows that the first constraint in (I2TT) can not be violated. 

Therefore, such a deviation can not exist and the nominal strategy must be a 77-NE for small 
enough e. Taking the limit as i] — > 0, it follows that the desired rates must lie in Cne- ■ 

Next, we turn to proving an analogue of Lemma [6] for the Gaussian model. To do this we 
need to define a parallel notion to the interference-free levels in the deterministic channel. In 
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a Gaussian channel, this again corresponds to the rate Lj, which can be achieved by treating 

interference as Gaussian noise. We still want to constrain both the common and private rates of 

each transmitter so that this rate is utilized with as much "common rate" as possible. Specifically, 

let 

SNR? 



an = log ( 1 
be the required private rate at user i and 



1 + INRy 



SNR,-SNRf 
h = log 1 ' 



l + SNR?+INRy 

be the required common rate at user i. The rate a, t is the rate achieved by user i's private signal 
when treating the aggregate interference plus noise as Gaussian noise, while the rate hi is the 
rate achieved by user i's common signal when treating its own private signal plus interference 
plus noise as Gaussian noise. 

We say that (Ri C , Ri P ) fully utilizes the interference free rate for user % if 

Ri P > a t (43) 

Ric > h. (44) 

With this definition we have the following analogue of Lemma [6l 

Lemma 14: If (i?i c , R\ p , R 2c , R^ v ) fully utilizes the interference free rate for each user i, then 
there exists random common rates R\ r , R 2r > such that (i?i c , R\ r , Ri p , Ri s , R2c, R2r, R2 P , R2s) 
is self- saturated at both receivers for any choice of Ru, R 2s . 

Proof: This proof parallels exactly the proof of Lemma [6l We will show that one can always 
increase R 2r such that the overall sum rate constraint (the first constraint in (|37l) ) is tight, so 
that receiver 1 is self- saturated. Suppose no such choice of R 2r exists. Then it must be that 
R 2r cannot be further increased because the second constraint in (1371) is tight. However if this 
constraint is tight, then since R\ c > b±, it can be seen that the first constraint must also be tight. 

■ 

To complete the generalization of the deterministic case, we need a parallel result to Lemma Ul 
which we state next. 

Lemma 15: For any point (R\, R 2 ) E Chk^E>~ there exists a non-randomized Han-Kobayashi 
rate-split that fully utilizes the interference-free levels at each transmitter. 
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Proof: As in the deterministic case, we begin with an arbitrary non-randomized Han- 
Kobayashi rate-split and show that this can always be transformed into one that fully utilizes 
the interference free levels at each receiver. Note that again since a^ + bi —Li, for any point in 
B~ there will always be a sufficient amount of "rate" available to meet the constraints in (|43l ) 
and (1441) . 

First, we show that if R ip < a ri for either user i, then we can always increase R ip and decrease 
R ic by the same amount until R ip = di. The only way such a transformation could not be done 
is if the second constraint in (1371) prevented it. But by combining d38l) with this constraint, it can 
be seen that this will never happen for R ip < a { . Moreover, since R ip does not appear in any of 
the constraints in (1371) at receiver j, such a change will never result in any of those constraints 
being violated. 

Thus we can assume that R ip > a { . Given this, if a rate-pair does not fully utilize the 
interference free levels at transmitter i, it must be that R ic < bi. Suppose that this is true for 
receiver 1 and consider increasing R lc and decreasing R Xp by the same amount until R\ c = bi. 
Note that since a,\ + b\ = L\ and R ic + R ip > L l5 when we decrease R lp in this way it will 
never cause it to become less than a%. Changing R\ p and R\ c in this manner will not violate 
any of the generalized MAC constraints at receiver 1, since every constraint in d37l) involving 
Ri c also involves R\ p . If this can be done without violating any constraints at receiver 2 then 
we are done. Otherwise, it must be that at least one of the constraints at receiver 2 involving 
R lc becomes tight when i? lc reaches the value R\ c — b\ — A, for some A > 0. The possible 
constraints here are the first and second. By the definition of B~ we have that R 2p + R2c < U 2 — 1 
and so 

R 2p + R 2c + R\ c = R 2 -\- R\ c 

<U 2 -l + h-A 

<log(l + SNR 2 + INR 2 i)-l- A (45) 

/ SNR 2 + INR 21 -INR^ 

This shows that the first constraint can not be tight. Note that the last inequality followed since 
INR^ 2 < 1. This implies that the second constraint must be tight, i.e., 

, , / SNRS + INRai-INRfA 

%+^=i°g(i-H 2 inr; ;; 1 a j. <46) 
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Proceeding as in (|45l) we have 

R 2p + R 2c + R* lc < log(l + SNR 2 + INR 21 ) - 1 - A 

/ , SNR 2 + INR 21 -INRf 2 ^ 

^ log l 1+ — ^n — J- A - 

Combining this with (|46|) we have 

, / SNR 2 -SNR!!-INR? 2 \ A 

< b 2 - A. 

And so it must also be that R 2p > a 2 + A. Now consider increasing i? lc from R* c by A, 
while simultaneously reducing i? lp and i? 2p each by A and also increasing R 2c by A. As in the 
deterministic case, the above calculations show that we will not violate any of the constraints 
in the modified MAC regions at either receiver when doing this. After this transformation, the 
resulting rate-split will fully utilize the interference free levels at both receivers. ■ 

Combining the previous lemmas we have shown that all points in Chk^B~ are hi Cne, proving 
the first part of Theorem [2l Applying the next lemma will complete this proof by generalizing 
Lemma \T5\ for strong IC and showing that in that case the conclusions apply for all points in 

ens. 

Lemma 16: For a strong IC, any point (R 1 , R 2 ) e Cfl£> can be achieved by a non-randomized 
Han-Kobayashi rate split that fully utilizes the interference-free levels at each transmitter. 

Proof: Recall, the for a strong interference channel, we set I N R? = for each user % and 
so we have a; = and b{ = Li. It follows that for any point (i?i, R 2 ) e Chk H B there will 
be exactly one non-randomized Han-Kobayashi rate split that achieves this rate, namely the one 
with R lc = Ri, R 2c = R 2 and R lp = R 2p = 0. This will trivially fully utilize the interference- 
free levels at each transmitter. Furthermore, for such a channel Chk = C, completing the proof. 

■ 

As in the deterministic case, it can also be shown by direct calculation that Cne will always 
contain at least one point that is sum-rate optimal to within 1 bit. 

V. Conclusions 

We have formulated a new information theoretic notion of a Nash equilibrium region for 
interference channels. Moreover, we have used this notion to characterize the equilibria in both 
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deterministic and Gaussian ICs. In the deterministic case we are able to exactly specify the Nash 
equilibrium region, while in the Gaussian case we characterize the Nash equilibrium region 
to within one bit. The analysis for the Gaussian case directly parallels our analysis for the 
deterministic case, and thus serves as another illustration of the utility of deterministic models 
in providing useful insights for the more complicated Gaussian setting. 

Our approach here is based on assuming that a given transmitter and the intended receiver 
share a source of common randomness. However, in the case of deterministic channels it is 
shown in 031 that this is not needed. Specifically, it is possible to achieve all points in C fl B 
by time-sharing among structured schemes which do no coding over time and use no common 
randomness. The key property of these structured schemes is that the common signals of the 
two users are segregated into separate levels at each of the receivers (in contrast to the random 
coding schemes considered in this paper, where the common signals of the two users are all 
mixed up.) Each transmitter may still use randomness to send a jamming signal on specified 
levels, but by aligning the jamming signal with the interfering common signal at the node's own 
receiver, the receiver does not need to decode it. Hence, the receiver needs not know the random 
bits generating the jamming signal. Such schemes can likely also be translated to the Gaussian 
settings by using structured codes instead of the Gaussian Han-Kobayashi schemes considered 
here. 

The games we were considering here were games with full information, i.e., each user has 
perfect knowledge of all channel gains as well as the code-books of the other user. One possible 
future direction for this work would be to relax this assumption and consider games with 
incomplete information. Another natural direction would be to consider interference networks 
with more than 2 users. Some preliminary work in this direction for deterministic channels is 
given in [21 J where it is shown that with more than two user efficient equilibria may no longer 
exist. 
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